Papers with generation methods
Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models exhibit a progressive left-leaning bias, but can also produce behavior that aligns with socioeconomic groups. |
| Approach: | They analyze whether persona prompting can accurately predict individual voting decisions . they find that they can simulate the voting behavior of European Parliament members reasonably well . |
| Outcome: | The proposed model can predict the voting behavior of European Parliament members reasonably well, with a weighted F1 score of approximately 0.793. |
Multimodal Generation with Consistency Transferring (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for multimodal content generation are limited to unimodal content production due to high training complexity, significant costs, and inadequate emphasis on model constraints. |
| Approach: | They propose a method to generate multimodal content with constraints on adjacent steps and a layer-based layer-constrained transfer between adjacent steps to improve denoising capabilities. |
| Outcome: | The proposed method improves the model’s ability to capture actions and depict backgrounds more effectively and improves video generation speed by approximately 40% and quality by about 39.3%. |
Generating Equation by Utilizing Operators : GEO model (2020.coling-main)
Copied to clipboard
| Challenge: | Existing neural models that use hand-crafted features are expensive and lack domain-specific knowledge. |
| Approach: | They propose a GEO model that uses operator-based features to generate equations using natural language sentences. |
| Outcome: | The proposed model outperforms state-of-the-art models on two datasets and 82.1% in ALG514. |
Slot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking (2022.coling-1)
Copied to clipboard
| Challenge: | Existing zero-shot learning methods ignore slot dependencies in a multidomain dialogue . experimental results show the effectiveness of our proposed method over existing state-of-art generation methods . |
| Approach: | They propose to use slot prompts combination, slot values demonstration and slot constraint object to model slot-slot dependency, slot-value dependency and slot-context dependency respectively. |
| Outcome: | The proposed method outperforms state-of-the-art methods under zero-shot/few-shot settings. |
Overcome Noise and Bias: Segmentation-Aided Multi-Granularity Denoising and Debiasing for Enhanced Quarduples Extraction in Dialogue (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for generating sentiment quadruples in dialogues face heightened noise and order bias challenges, leading to decreased robustness and accuracy. |
| Approach: | They propose a Segmentation-Aided multi-grained denoising and debiasing method to address noise and order bias challenges in ABSA. |
| Outcome: | The proposed method achieves word-level denoising and utterance-level demoising via topic-aware dialogue segmentation. |
A Generation-based Deductive Method for Math Word Problems (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing generation methods suffer from repeated sub-expression generation and deductive methods are restricted to dealing with binary operations. |
| Approach: | They propose a multivariate directed acyclic graph (mDAG) which generates the topological ordering of mDAg by equipping a generation model with a re-encoder to keep the deductive property but avoid the expensive enumeration of deductive methods. |
| Outcome: | The proposed model performs well on the widely used benchmarks and solves multivariate operators on the CMWPA benchmark. |
Multimodal Dialogue Response Generation (2022.acl-long)
Copied to clipboard
Qingfeng Sun, Yujing Wang, Can Xu, Kai Zheng, Yaming Yang, Huang Hu, Fei Xu, Jessica Zhang, Xiubo Geng, Daxin Jiang
| Challenge: | Existing studies focus on multimodal dialogue models but neglect generation methods. |
| Approach: | They propose a multimodal dialogue response generation task which requires multimodal dialogs containing both texts and images which are difficult to obtain. |
| Outcome: | Experiments show that the proposed model can generate informative text and high-resolution image responses. |
Faithfulness-Aware Decoding Strategies for Abstractive Summarization (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on faithfulness of abstractive summarization have focused on decoding strategies. |
| Approach: | They propose two faithfulness-aware generation methods to further improve faithfulness . they propose to use a distillation approach to generate faithful summaries with greedy decoding . |
| Outcome: | The proposed methods improve faithfulness across two datasets as evaluated by automatic faithfulness metrics and human evaluation. |
A Survey on Natural Language Counterfactual Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in NLP are driven by a variety of Large Language Models (LLMs), such as GPT-3 (175B) and PaLM (540B). |
| Approach: | They propose a taxonomy that categorizes the methods into four groups and summarizes the metrics for evaluating the generation quality. |
| Outcome: | The proposed taxonomy categorizes the generation methods into four groups and summarizes the metrics for evaluating the quality. |
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained neural language models (LMs) are prone to generating toxic language . we investigate the extent to which pretrained LMs can be prompted to generate toxic language. |
| Approach: | They propose to use a dataset to test the extent to which pretrained LMs can generate toxic language . they use toxicity-based text generation algorithms to generate toxic text from natural prompts . |
| Outcome: | The proposed model can degenerate into toxic text even from seemingly innocuous prompts. |
A Rigorous Evaluation of LLM Data Generation Strategies for Low-Resource Languages (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used to generate synthetic textual data for training smaller specialized models. |
| Approach: | They evaluate the performance of large language models and their generation strategies in 11 different languages using 3 NLP tasks and 4 open-source LLMs. |
| Outcome: | The proposed generation strategies and their combinations yield strong results across 11 languages, including several extremely low-resource ones. |
SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Incorporating Cutting-Edge Generation Methods (2025.acl-long)
Copied to clipboard
| Challenge: | Existing speech deepfake datasets are limited in scale and diversity, making it challenging to train models that can generalize well to unseen deepfakkes. |
| Approach: | They propose a large-scale speech deepfake dataset that includes over 3 million deepfak samples, totaling more than 3,000 hours of audio, generated using 40 different speech synthesis tools. |
| Outcome: | The proposed dataset includes over 3 million deepfake samples, totaling more than 3,000 hours of audio, generated using 40 different speech synthesis tools. |
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing counterfactual generation methods rely on manual labor to create very few counterf actuals or only instantiate limited types of perturbations such as paraphrases or word substitutions. |
| Approach: | They propose a general-purpose counterfactual generator that allows for control over perturbation types and locations. |
| Outcome: | The proposed generator produces diverse sets of realistic counterfactuals that are useful in various applications. |
Video Caption Dataset for Describing Human Actions in Japanese (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing video caption datasets for English have no equivalent for Japanese . authors evaluated two methods to obtain benchmark results . |
| Approach: | They propose to use Japanese video captions to describe human actions . they evaluated two different methods to obtain benchmark results . |
| Outcome: | The proposed dataset evaluates two different methods to obtain benchmark results . it shows that the generation methods can specify "who does what and where" |
Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for forward counterfactual generation face limitations . large language models (LLMs) offer promise but remain unexplored for this application . |
| Approach: | They propose a benchmark to support forward counterfactual generation in finance . they use financial news headlines to curate financial news and provide structured evaluation . |
| Outcome: | The proposed benchmark aims to provide scalable, automated insights into potential market opportunities and risks for stakeholders. |
From Objectives to Questions: A Planning-based Framework for Educational Mathematical Question Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Traditional generation methods focus primarily on textual quality, but they fail to meet complex, multifaceted educational requirements. |
| Approach: | They propose a method for automatic generating high-quality mathematical problems that align with educational objectives using a dataset of 16k mathematical questions with multi-dimensional educational objectives. |
| Outcome: | The proposed method improves generating high-quality mathematical questions that meet multi-dimensional educational objectives. |
Generating Summaries with Controllable Readability Levels (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current text generation approaches focus on a specific readability level, resulting in texts that are not customized to readers’ proficiency levels. |
| Approach: | They propose to generate summaries with fine-grained control over their readability by using instruction-based readability control, reinforcement learning and lookahead to estimate readability of upcoming decoding steps. |
| Outcome: | The generated summaries with different readability levels were compared with previous methods that focus on a specific readability level (e.g., lay summarization) and a lookahead approach significantly improved readability control on news summarizing. |
From Style to Story: A Curriculum Learning Approach for Imitative Novel Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Novels create rich, immersive worlds with intricate plots and distinct styles, captivating readers through complex storytelling. |
| Approach: | They propose a novel generation system that imitates novel elements by predicting plot developments and writing concrete details using vivid, expressive language. |
| Outcome: | The novel imitative novel generation system is trained through a curriculum learning paradigm, progressing from low-level stylistic mastery to high-level narrative coherence. |
Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | federated learning (FL) fine-tunes large language models with local data, but organizations are reluctant to share local data. |
| Approach: | They propose a framework for fine-tuning large language models with local data . they propose centralized fine- tuning with local datasets is a good idea . |
| Outcome: | The proposed framework allows clients to retain local data while sharing only model parameters for training. |